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(54) Apparatus and method for displaying three-dimensional image 



(57) An apparatus and method for displaying a 
three-dimensional image provides a three-dimensional 
image having a wide viewing angle and having no dis- 
tortion. The apparatus includes an aspectogram con- 
taining a plurality of two-dimensional microimages dis- 
played in real time, a microlens array for synthesizing 
the two-dimensional microimages and regenerating 
them in a three-dimensional image, a head tracking sys- 
tem for tracing movement of an observer head that ob- 
serves the three-dimensional image, in real time, a head 
position detector for calculating the position of the ob- 
server head traced by the head tracking system, an as- 



pectogram regeneration engine for regenerating the mi- 
croimages in accordance with a signal input from the 
head position detector to compensate distortion of the 
three-dimensional image, and a viewing adjust engine 
for adjusting a viewing zone of the three-dimensional im- 
age by moving the regenerated microimages to form a 
new viewing zone centered relative to the moved ob- 
server head in accordance with a signal input from the 
head position detector and the aspectogram regenera- 
tion engine. Thus, the three-dimensional image having 
no distortion can be observed without limitations im- 
posed by a restricted size of the viewing zone. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001] The present invention relates to an apparatus 
and method for displaying a three-dimensional image in 
real time. 

2. Description of the Related Art 

[0002] Recently, a three-dimensional image process- 
ing technology is used in various fields such as educa- 
tion, training, medical treatment, and computer games. 
The three-dimensional image is more useful than a two- 
dimensional image in that it has presence feeling, real 
feeling, and natural feeling. 

[0003] Many researches for implementing such a 
three-dimensional image display are currently in 
progress. 

[0004] The three-dimensional image display requires 
various technologies such as input technology, process- 
ing technology, transmission technology, display tech- 
nology, and software technology. Particularly, it essen- 
tially requires researches forthe display technology, dig- 
ital image processing technology, computer graphic 
technology, and human visual system. 
[0005] The most fundamental method of the three-di- 
mensional image display is based on glasses. As typical 
examples, there are a color separation mode, a polar- 
ized glasses mode, and a liquid crystal shutter mode. 
The color separation mode permits a viewer to observe 
images through color glasses using different light wave- 
lengths. The polarized glasses mode is based on differ- 
ent light oscillation directions. The liquid crystal shutter 
mode permits a viewer to observe left and right images 
by temporally dividing the images. 
[0006] The glasses-based three-dimensional image 
display method provides picture quality of high definition 
but has two drawbacks. The one drawback arises from 
inconvenience caused by wearing glasses and the other 
drawback arises in that only scenographic feeling exists 
in a fixed visual point. For these reasons, researches for 
direct three-dimensional image display without wearing 
glasses are currently in progress. 
[0007] The direct three-dimensional image display 
separates left and right images without using glasses, 
especially separates images corresponding to left and 
right eyes in a particular observation position using a 
parallax barrier, a lenticular plate, or a fly eye lens plate. 
[0008] Particularly, an integral photography mode is 
well known. This integral photography mode records, 
transmits, and regenerates three-dimensional images 
formed by a fly eye shaped microlens array. 
[0009] In more detail, as shown in Fig. 1 , a microlens 
array 10 having fly eye shaped microlens arrays 11 is 
arranged, and a number of microimages 1 3 of a subject 



entered through each microlens 11 are recorded on a 
printing paper in a microimage focus surface 12. 
[0010] If light is illuminated at the rear of the printing 
paper, respective microimages 1 3 recorded on the print- 

5 ing paper progress in the same path as when the subject 
is taken, so that a three-dimensional image 1 4 is regen- 
erated in an original subject position. 
[001 1 ] However, a comfortable viewing zone that can 
observe the regenerated three-dimensional image is 

10 limited to a boundary of the three-dimensional image 1 4. 
[0012] For example, a viewing angle of a two-dimen- 
sional display based on a cathode ray tube (CRT), a 
plasma display panel (PDP), and a liquid crystal display 
(LCD) is approximate to 1 20W but a viewing angle of a 

15 three-dimensional display such as an integral photogra- 
phy is about 20° or less. 

[0013] Figs. 2a and 2b show three-dimensional imag- 
es observed in a zone other than inside and outside of 
a viewing angle of an apparatus for displaying a three- 

20 dimensional image. 

[0014] As shown in Fig. 2a, two-dimensional microim- 
ages are provided on a screen 22. The microimages are 
synthesized to a three-dimensional image 23 through a 
microlens array 21 and then regenerated. At this time, 

25 an observer 24 located within a boundary 25 of a main 
viewing zone 26, i.e., within a viewing angle of the ap- 
paratus for displaying a three-dimensional image can 
observe the regenerated three-dimensional image 23. 
[0015] The viewing angle 2co that can observe the re- 

30 generated three-dimensional image 23 is limited to the 
boundary of the three-dimensional image. 
[0016] As shown in Fig. 2b, if an observer 27 moves 
out of the main viewing zone 26 marked by dotted lines, 
he is entering into a satellite viewing zone 29 remarked 

35 by solid lines. 

[0017] The observer 27 observes a satellite image 28 
in the satellite viewing zone 29. The satellite image 28 
is observed within the viewing angle 2co, as shown in 
Fig. 2a. 

40 [0018] The satellite image 28 observed in the satellite 
viewing zone 29 is similar to the image 23 observed in 
the main viewing zone of Fig. 2a. However, the satellite 
image 28 has a seriously distorted three-dimensional 
image. This is because that an angle between vertical 

45 and horizontal directions in the regenerated satellite im- 
age 28 is different from an angle of the regenerated im- 
age 23 of Fig. 2a. 

[0019] As described above, the related art apparatus 
for displaying a three-dimensional image has a problem 
50 in that the viewing angle that can stably observe a three- 
dimensional image is narrow. For this reason, another 
problem arises in that the apparatus for displaying a 
three-dimensional image is limited in its use range. 

55 SUMMARY OF THE INVENTION 

[0020] To address the above problems, it would be de- 
sirable to provide an apparatus and method for display- 
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ing a three-dimensional image in real time, in which a 
three-dimensional image having no distortion out of a 
viewing zone can stably be observed. 
[0021] Accordingly, an apparatus for displaying a 
three-dimensional image according to the present in- 
vention, which synthesizes two-dimensional microimag- 
es and regenerates them in a three-dimensional image, 
includes a detector for tracing movement of an observer 
head that observes the three-dimensional image, in real 
time and detecting the position of the observer head, 
and a compensator for adjusting a viewing zone of the 
three-dimensional image and/or compensating distor- 
tion of the three-dimensional image in accordance with 
a signal input from the detector. 
[0022] Preferably, the detector includes a head track- 
ing system which traces movement of the observer head 
in real time, and a head position detector for calculating 
the position of the observer head traced by the head 
tracking system. Preferably, the compensator includes 
either a viewing zone adjust engine which adjusts the 
viewing zone of the three-dimensional image by moving 
the microimages in accordance with a signal input from 
the head position detector, or an aspectogram regener- 
ation engine which compensates distortion of the three- 
dimensional image by regenerating the microimages in 
accordance with the signal input from the head position 
detector. 

[0023] According to a second aspect of the invention 
an apparatus for displaying a three-dimensional image 
includes an aspectogram containing a plurality of two- 
dimensional microimages displayed in real time, a mic- 
rolens array for synthesizing the two-dimensional micro- 
images and regenerating them in a three-dimensional 
image, a head tracking system for tracing movement of 
an observer head that observes the three-dimensional 
image, in real time, a head position detector for calcu- 
lating the position of the observer head traced by the 
head tracking system, and a viewing adjust engine for 
adjusting aviewingzone of thethree-dimensional image 
by moving the microimages in accordance with a signal 
input from the head position detector. 
[0024] Preferably, the apparatus further includes an 
aspectogram regeneration engine which regenerates 
the microimages in accordance with the signal input 
from the head position detector to compensate distor- 
tion of the three-dimensional image. Preferably also, the 
regenerated microimages are moved to form a viewing 
zone centered relative to the observer head by the view- 
ing adjust engine. 

[0025] According to a third aspect of the invention an 
apparatus for displaying a three-dimensional image in- 
cludes an aspectogram containing a plurality of two-di- 
mensional microimages displayed in real time, a micro- 
lens array for synthesizing the two-dimensional micro- 
images and regenerating them in a three-dimensional 
image, a head tracking system for tracing movement of 
an observer head that observes the three-dimensional 
image, in real time, a head position detector for calcu- 



lating the position of the observer head traced by the 
head tracking system, and an aspectogram regenera- 
tion engine for regenerating the microimages in accord- 
ance with a signal input from the head position detector 
5 to compensate distortion of the three-dimensional im- 
age. 

[0026] Preferably, the apparatus further includes a 
viewing adjust engine which adjusts a viewing zone of 
the three-dimensional image by moving the regenerated 
10 microimages to form the viewing zone centered relative 
to the observer head in accordance with a signal input 
from the head position detector and the aspectogram 
regeneration engine. 

[0027] The invention also provides a method for dis- 

15 playing a three-dimensional image which synthesizes 
two-dimensional microimages and regenerates them in 
a three-dimensional image, including the steps of tracing 
movement of an observer head that observes the three- 
dimensional image, in real time, calculating the position 

20 of the traced observer head, and adjusting a viewing 
zone of the three-dimensional image and/or compensat- 
ing distortion of the three-dimensional image, in accord- 
ance with the calculated position of the observer head. 
[0028] Preferably, the step of adjusting the viewing 

25 zone of the three-dimensional image includes the step 
of moving the main viewing zone to be centered -relative 
to the observer head by moving the two-dimensional mi- 
croimages. Preferably, the step of compensating distor- 
tion of the three-dimensional image includes the step of 

30 regenerating the two-dimensional microimages. 

[0029] In the operation of embodiments of the inven- 
tion, if the observer head moves out of the viewing zone, 
the head tracking system traces movement of the ob- 
server head and transmits a resultant signal to the as- 

35 pectogram regeneration engine and/or the viewing ad- 
just engine. The aspectogram regeneration engine re- 
generates the microimages so as not to be distorted 
even in the position of the moved observer head. The 
viewing adjust engine moves the regenerated microim- 

40 ages to form the viewing zone centered relative to the 
observer head so that the three-dimensional image hav- 
ing no distortion can be observed from an arbitrary head 
position, thereby obtaining a wide and comfortable view- 
ing angle. 

45 [0030] It is to be understood that both the foregoing 
general description and the following detailed descrip- 
tion are exemplary and explanatory and are intended to 
provide further explanation of the invention as claimed. 

50 BRIEF DESCRIPTION OF THE DRAWINGS 

[0031] Other objects, characteristic features and ad- 
vantages of the present invention will now become ap- 
parent with a detailed description of an embodiment 
55 made with reference to the accompanying drawings, in 
which: 

Fig. 1 shows a method for displaying a general 
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three-dimensional image; 

Fig. 2 shows three-dimensional images regenerat- 
ed in accordance with movement of an observer 
head in a related art apparatus for displaying a 
three-dimensional image; and 
Figs. 3 to 5 show apparatuses for displaying a three- 
dimensional image according to the first to third em- 
bodiments of the present invention. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

[0032] The following is a detailed description of pre- 
ferred embodiments of apparatus and methods for dis- 
playing a three-dimensional image according to the 
present invention made with reference to the accompa- 
nying drawings , by way of example only. 
[0033] Fig. 3 shows an apparatus for displaying a 
three-dimensional image according to the first embodi- 
ment of the present invention. 

[0034] As shown in Fig. 3, an aspectogram containing 
two-dimensional microimages is provided on a screen 
32. The microimages are synthesized to a three-dimen- 
sional image 39 through a microlens array 31 and then 
regenerated. At this time, the apparatus for displaying 
a three-dimensional image according to the first embod- 
iment of the present invention further includes a head 
tracking system 33, a head position detector 34, and a 
viewing adjust engine 35, unlike the related art. 
[0035] The head tracking system 33 traces movement 
of an observer head that acts to observe the three-di- 
mensional image, in real time. The head position detec- 
tor 34 calculates the position of the observer head 
traced by the head tracking system 33. The viewing ad- 
just engine 35 moves the microimages to form a new 
viewing zone centered relative to the observer head in 
accordance with a signal input from the head position 
detector 34, so that the viewing zone of the three-dimen- 
sional image is adjusted. 

[0036] The operation of the apparatus for displaying 
a three-dimensional image according to the first embod- 
iment of the present invention will now be described. 
[0037] If the observer head 40 moves from the center 
of a main viewing zone to a boundary 38 of the main 
viewing zone, the head tracking system 33 traces move- 
ment of the observer head and transmits a resultant sig- 
nal to the head position detector 34. 
[0038] The head position detector 34 calculates the 
position of the observer head in accordance with the sig- 
nal of the head tracking system 33, and then transmits 
the calculated signal to the viewing adjust engine 35. 
[0039] The viewing adjust engine 35 moves the mi- 
croimages displayed on the screen 32 in accordance 
with an input signal so that the viewing zone is adjusted 
to correspond to the position of a new observer head 40. 
[0040] A new viewing zone arising from movement of 
the observer head 40 is shown in dotted lines 41 . 
[0041] The method for adjusting the viewing zone ac- 



cording to the first embodiment of the present invention 
provides a viewing zone that can stably observe a three- 
dimensional image even if the observer head 40 moves. 
However, in this method, a three-dimensional image 42 

5 having some distortion is still observed. 

[0042] Fig. 4 shows an apparatus for displaying a 
three-dimensional image according to the second em- 
bodiment of the present invention. In the second em- 
bodiment of the present invention, instead of the viewing 

10 adjust engine 35, an aspectogram regeneration engine 
36 is additionally provided. The aspectogram regener- 
ation engine 36 regenerates the aspectograms in ac- 
cordance with a signal input from the head position de- 
tector 34 to compensate distortion of the three-dimen- 

15 sional image. 

[0043] The operation of the apparatus for displaying 
a three-dimensional image according to the second em- 
bodiment of the present invention will now be described. 
[0044] If an observer head 43 departs from a bound- 

20 ary 38 of a limited main viewing zone 38 and moves to 
a boundary 44 of a satellite viewing zone, the head 
tracking system 33 detects movement of the observer 
head in real time and transmits a resultant signal to the 
head position detector 34. 

25 [0045] The head position detector 34 calculates the 
position of the observer head in accordance with the sig- 
nal of the head tracking system 33, and then transmits 
the calculated signal to the aspectogram regeneration 
engine 36. 

30 [0046] The aspectogram regeneration engine 36 re- 
generates the microimages displayed on the screen 32 
in accordance with the input signal in new microimages 
of which distortion is compensated. 
[0047] As described above, the observer can observe 

35 a three-dimensional image having no distortion even in 
a satellite viewing zone other than a main viewing zone 
due to regeneration of the microimages of which distor- 
tion is compensated. 

[0048] However, since the viewing zone that can sta- 
40 bly observe the three-dimensional image in accordance 
with movement of the observer is not provided, it is likely 
that the three-dimensional image is biased to one direc- 
tion. 

[0049] Fig. 5 shows an apparatus for displaying a 
45 three-dimensional image according to the third embod- 
iment of the present invention. In the third embodiment 
of the present invention, both the viewing adjust engine 
35 of the first embodiment and the aspectogram regen- 
eration engine 36 of the second embodiment are addi- 
50 tionally provided. 

[0050] As shown in Fig. 5, an observer 37 observes 
a three-dimensional image 39 displayed by synthesizing 
the two-dimensional microimages provided on the 
screen 32 through the microlens array 31 . 
55 [0051] If the observer head 37 is within the main view- 
ing zone, no signal occurs in the head position detector 
41. However, if the observer head 46 moves to either 
the boundary of the main viewing zone or out of the 
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boundary, the head tracking system 33 directly traces 
movement of the observer head and transmits a result- 
ant signal to the head position detector 34. 
[0052] The head position detector 34 calculates the 
position of the observer head in accordance with the sig- 
nal of the head tracking system 33, and then transmits 
the calculated signal to both the aspectogram regener- 
ation engine 36 and the viewing adjust engine 35. 
[0053] The aspectogram regeneration engine 36 re- 
generates the two-dimensional microimages displayed 
on the screen 32 in accordance with the input signal in 
new microimages of which distortion is compensated. 
The viewing adjust engine 35 adjusts the viewing zone 
to correspond to the position of a new observer head 46 
by moving the new microimages displayed on the 
screen 32 in accordance with the input signal and of 
which distortion is compensated. 
[0054] In the third embodiment which is the most pre- 
ferred embodiment of the present invention, comforta- 
ble three-dimensional image having a wide viewing an- 
gle without distortion can be observed. The present in- 
vention is applicable to the microimages of all display 
devices such as an LCD, a PDP, a CRT, and a screen 
having a projection system. 

[0055] As aforementioned, apparatus and methods 
for displaying a three-dimensional image according to 
the present invention have the following advantages. 
[0056] Since the three-dimensional image having no 
distortion is provided even if the observer head moves 
out of the main viewing zone, a wide viewing angle can 
be obtained. 

[0057] The above description will enable one skilled 
in the art to modify and revise the described embodi- 
ments not degrading the technical concept of the 
present invention. However, the technical scope of the 
present invention is not limited to the above description 
of the embodiment but shall be determined by the 
claims. 



Claims 

1 . An apparatus for displaying a three-dimensional im- 
age, which synthesizes two-dimensional microim- 
ages and regenerates them in a three-dimensional 
image, the apparatus comprising: 



eludes a head tracking system which traces move- 
ment of the observer head in real time, and a head 
position detector for calculating the position of the 
observer head traced by the head tracking system. 

5 

3. The apparatus of claim 1 or 2, wherein the compen- 
sator includes either a viewing adjust engine which 
adjusts the viewing zone of the three-dimensional 
image by moving the microimages in accordance 

10 with a signal input from the head position detector, 
or an aspectogram regeneration engine which re- 
generates the microimages in accordance with the 
signal input from the head position detector to com- 
pensate distortion of the three-dimensional image. 

15 

4. An apparatus for displaying a three-dimensional im- 
age, comprising: 

an aspectogram containing a plurality of two- 
20 dimensional microimages displayed in real 

time; 

a microlens array for synthesizing the two-di- 
mensional microimages and regenerating them 
in a three-dimensional image; 

25 a head tracking system for tracing movement 

of an observer head that observes the three- 
dimensional image, in real time; 
a head position detector for calculating the po- 
sition of the observer head traced by the head 

30 tracking system; and 

a viewing adjust engine for adjusting a viewing 
zone of the three-dimensional image by moving 
the microimages in accordance with a signal in- 
put from the head position detector. 

35 

5. The apparatus of claim 4, further comprising an as- 
pectogram regeneration engine which regenerates 
the microimages in accordance with the signal input 
from the head position detector to compensate dis- 

40 tortion of the three-dimensional image. 

6. The apparatus of claim 5, wherein the regenerated 
microimages are moved to form a new viewing zone 
centered relative to the moved observer head by the 

45 viewing adjust engine. 

7. An apparatus for displaying a three-dimensional im- 
age, comprising: 

an aspectogram containing a plurality of two- 
dimensional microimages displayed in real 
time; 

a microlens array for synthesizing the two-di- 
mensional microimages and regenerating them 
in a three-dimensional image; 
a head tracking system for tracing movement 
of an observer head that observes the three- 
dimensional image, in real time; 



a detector for tracing movement of an observer 
head that observes the three-dimensional im- 
age, in real time and detecting the position of 50 
the observer head; and 
a compensator for adjusting a viewing zone of 
the three-dimensional image and/or compen- 
sating distortion of the three-dimensional im- 
age in accordance with a signal input from the 55 
detector. 

2. The apparatus of claim 1 , wherein the detector in- 
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a head position detector for calculating the po- 
sition of the observer head traced by the head 
tracking system; and 

an aspectogram regeneration engine for regen- 
erating the microimages in accordance with a 5 
signal input from the head position detector to 
compensate distortion of the three-dimensional 
image. 

8. The apparatus of claim 7, furthercomprising a view- 10 
ing adjust engine which adjusts a viewing zone of 

the three-dimensional image by moving the regen- 
erated microimages to form a new viewing zone 
centered relative to the moved observer head in ac- 
cordance with a signal input from the head position 15 
detector and the aspectogram regeneration engine. 

9. A method for displaying a three-dimensional image, 
which synthesizes two-dimensional microimages 
and regenerates them in a three-dimensional im- 20 
age, the method comprising the steps of: 

tracing movement of an observer head that ob- 
serves the three-dimensional image, in real 
time; 25 
calculating the position of the traced observer 
head; and 

adjusting a viewing zone of the three-dimen- 
sional image and/or compensating distortion of 
the three-dimensional image, in accordance 30 
with the calculated position of the observer 
head. 

1 0. The method of claim 9, wherein the step of adjusting 

the viewing zone of the three-dimensional image in- 35 
eludes the step of forming a new viewing zone cen- 
tered relative to the moved observer head by mov- 
ing the two-dimensional microimages. 

11. The method of claim 9 or 10, wherein the step of 40 
compensating distortion of the three-dimensional 
image includes the step of regenerating the two-di- 
mensional microimages. 
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FIG . 1 
Related Art 
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FIG . 2a 
Related Art 




FIG . 2b 
Related Art 
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